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Tlie learning packct.s develop&d by the Special Education Supervisor 
Training Project (SEST) at the University of Texas at Austin are compe' 
tency-guidcd training materials keyed to selected critical competencies 
for professional supervisory personnel in school leadership positions. 
A series of ten packets, each dealing with one of tvenl^-four critical 
competencies, has been developed. A list of the Items available in the 
series appears oa the last page of this document* These packets were 
developed locally to mcst the need for independent study mtcrlal to 
supplement fornuil training and field experiences in a professional prep- 
aration program* 

This learning packet is intended for inclusion in a learning la^- 
ratory containing packets and many other types of materials for use in 
Independent study* The equipment necessary to use those materials, as 
veil as work space, is provided in the Learning Lab to assist users in 
choosing material and working through it at their ovn pace* A complete 
directory of material in the Learning Lab at the University of Texas 
DcpartJtent of Educational Administration has been published by the SEST 
Project under the title, A Directory of Competency-Guided Supervisory 
TrnXniDR Materials for Independent Study * 

The learning packets have undergone extensive evaluation and revi* 
sion through the coordinated efforts of several people* Corine Martinez 
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OVERVIEW 



CoDpetency: 

Given an array of learning resources currently available for use^ the 
supervisor can design and conduct a study to determine the extent and 
appropriateness of their utilization^ and based on the results of that 
study» can make recoimendatior«s for the improved utilization of spe- 
cific learning resources in specific vays* 



Objectives: 

Objectives for the ciodule can be divided into two aajor categories: 
(1) collecting preliminary information about ^at materials are avail- 
able, vho is using it, uhat is not being tised» and how present learning 
resources rate on an evaluation checklist; and (2) observing teachers 
and students using materials^ interviewing teachers, pupils and others 
about learning materials^ and what assistance they need to improve 
their use of the materials* 

1. Collecting Preliminary Information 

a. Identify, list, and briefly describe the sources of instruction- 
al materials/learning resources available to teachers* 

b* Develop a form for inventorying the learning resources avail- 
able in selected classrooms at a given time* 

c* Formulate procedures for determining which materials are not 
being used* 

d* Infer, tentatively^ the reasons non-users fail to exploit the 
sources of materials* 

e* Develop a learning materials evaluative checklist of character- 
istics* 

f * Evaluate given learning resources using the checklist* 
g* Prepare guidelines for determining if materials are being used 
appropriately* 

2* Conducting a Formal Study of Materials Utilization 

a* Develop a form for recording observations of pupil"? and teachers' 
using learning resources* 

b* Develop a questionnaire or interview form that will elicit from 
teachers and pupils their perceptions of the desirability of 
given learning resources and the positive and negative aspects 
of using the resources. 

c« Develop a questionnaire or interview form to be used with other 
professional personnel yho observe and/or participate in the 
choice and use of learning resources at the building level* 



Develop a questionnaire or Interview form that will elicit 
from teachers suggestions about the assistance they feel is 
needed to improve use of instructional Etaterials* 



Evaluation : 

Upon completion of these task assigmaents, the user vill success- 
fully respond to the Self-Evaluation Checklist, using the Checklist 
Answer Sheet provided^ and will pass the post'test^ using the Post*TeSt 
Answer Sheet < 



DIRECTIONS 



1- Take the Post-Test. If you feel fairly confident of your ability to 
evaluate the utilization of learning resources, skip to the back of the 
packet and take the Post-Test. Use the Post-Test Answer Sheet to record 
your answers. 

2. Score Your Test. Score your test from the Post-Test Answers, page 29. 
if 75 percent of your answers are correct (16 of the items), consider your- 
self as having met the criteria for achievement on this module. If you 
responded to less than 75 percent of the answers correctly, continue with 
tlie module. 

3. Read ^'Description of Situation" and **Task Assignment." (Pages 4-7) . 
You may want to put a paperclip on this part of the aodule or use a 
bookmarker for handy reference later. 

4. Read **Part I: Collecting Preliminary InformaDlon." 

5. Read "Part II: Conducting a Formal Study of Materials Utilization." 

6. Use the bibliography , page 31 > to locate other sources of information 
on evaluating utilization of learning resources, before writing your task 
assignment. 

7. Write the task asslgianent^ referring frequently to pages 4-5, "D«cJrlp- 
tion of Situation'* and "Task Assignment," pages 6-7. 

8. Complete the Self-Evaluation Checklist , using the Self -Evaluation 
Checklist Answer Sheet at the end of the packet to record your answers. 

9- Take the Posf^est . Answer using the Post-Test Answer Sheet pro- 
vided at che end of the module. If you do not answer at least 75 percent 
of the Items correctly (16 items), reread the module. 

10. Read "Applying the Results of the Materials Utilization Study/' pages 
32^35 > for further suggestions. 



8 



DESCRIPTION OF SITUATION 



Assuoe that you are the new supervisor in XYZ School District. It 
is January and you have had an opportunity to get somewhat acquainted with 
your job- 

The District 

The district in which you work has 20^000 pupilis in two high schools^ 
five niddlfi schools^ and sixteen elementary schools. It is staffed by a 
general superintendent and two assistant superintendents^ one of whom^ 
your superior^ is the assistant superintendent for curriculum and instruc- 
tion. There are supervisory personnel in the major subject areas^ kin- 
dergarten^ primary^ learning resources (new name for libraries) and 
counseling . 

The district is suburban^ largely middle class^ and has a high pro- 
portion of lower middle class constituents. Its ethnic composition is 
25% Blacky 12% Mexican- American^ and 63% White. The constituents are 
fairly conservative politically and educationally. Host vork in industry^ 
construction^ or as office workers. The tax base for the district is 
large and the economic index is high because of the large amount of in- 
dustry located in the district. 

Official district policy says that instructional improvement and in- 
service education are priorities^ but little released time or salary in- 
ducments are provided. Funds for special. projects are usually available 
for the asking, however. 

The curriculum in the district is largely subject-centered. All 
schools are graded and most are housed in buildings less than 20 years 
old but with self-contained classrooms. Each school is staffed with a 
library /learning resources specialist. 

Special education clasf^es have been held on a categorical basis 
for many years, but last year, after a phaserdiiof one year, the district 
moved into Plan A, Mentally retarded pupils are still grouped in separate 
classes. Other pupils are taught in resource rooms or by resource teachers 
in their regular classrooms. A number of the resource teachers were moved 
from categorical assignments into the resource rooms along with n^ per- 
sonnel, most of whom have just completed teacher education programs. 

Your situation 

You have visited in most classes during the first semester. You have 
held one in-service meeting and have participated with teachers in district 
professional association laeetings and in an Education Service Center work- 
shop on implementation of Plan A. 



As you have visited classes and talked with teachers, you become 
aware that many of them are concerned about (1) achievement of pupils 
which the teachers perceive to be less than it should be, and (2) disin- 
terest of many pupils in. school and in the activities that go on there. 

Teachers are asking for help in dealing with certain types of 
problems: the pupil who will not participate in reading instruction 
from basal textbooks? the pupil whose speech is so poor he has diffi- 
culty getting along with others; the pupil who cannot seem to learn 
math although he is able to count; the pupil who never stays in one 
place more than two minutes; the diild who Is said to be hard of hear* 
ing and who does not speak, but who the teacher suspects can hear and 
does understand language; and the cerebral palsied child confined to a 
wheelchair wbo doesn't want to do anything but watch television. Several 
teachers have suggested that they need better instructional materials 
to use with these pupils. 

You are particularly concerned about teacher morale. The teach* 
ers seem to feel that they cannot do anything about curriculum themselves 
and that the choice in appropriate instructional materials is quite lim- 
ited. _ 

You outline the problems you have observed to yourself and de- 
termine to talk with your superior, the assistant superintendent for 
curriculum and instruction. You request funds fo^ additional materials. 



frustrations. The assistant superintendent hears your request, but im- 
mediately comes back with the question, 'Vhat happened to all that 
$23,000 that was spent cn materials three years ago? Can't the teadiers 
use them?" No one told you that so much had been spent on materials 
two years ago and you also wonder what happened to it. Why do teachers 
seem to imply that more materials are needed? 

Some checking reveals that part of the funds went to an instruc- 
tional TV consortium in the area for programming; wireless amplification 
systems were installed in three schools which had hard-of-hearing classes; 
and television receivers were bought for 2/3 of the classrooms. Such ex- 
penditures left little for investment in software. 

The following Task Assignment outlines specific tasks to be accom- 
plished in response to-this situation. 



which would catch teachers' 




TASK ASSIGNMENT 



Low teacher morale concerning the variety of materials to use 
with many different kinds of students can be Identified as the problem. 
It Is your task to collect information on what Is available and If It 
Is being used, and to Improve the use of learning resources* 

Specifically your tasks for this learning packet are to: 

1* Collect Preliminary Information 

a* Identify, list and briefly describe the sources of In- 
structional materials/learning resources available to 
teachers* 

b. Develop a form for Inventorying the learning resources 
available In a classroom at a given time* 

c* Prepare a brief report on procedures for determining 
which materials are not being used* 

d* Prepare a brief report on the possible reasons non- 
users do not exploit the sources of materials* 

e* Develop an evaluative checklist of learning materials 
characteristics* 

f* Evaluate one of the following using the learning materi- 
als checklist: 
1- culsenalre rods 

2* Sullivan programmed reading (one component) 
3» Cracking the Code, SRA 
4* Other well-known learning material 
g» Prepare district guidelines to determine if materials are 
being used appropriately* 

2* Conduct a Formal Study of Materials Utilization 

a* Develop a form for recording observations of pupils and 
teachers using learning resources 

OR 

b* Develop a questionnaire or Interview form that will elicit 
from teachers and pupils their perceptions of the desira- 
bility of given learning resources and the positive and 
negative aspects of using the resources* 

c* Develop a questionnaire or interview form to be used with 
other professional personnel who observe and/or partici- 
pate in the choice and use of learning resources at the 
building level* 
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Develop a questionnaire or Interview form that will 
elicit from teachers suggestions about the assistance 
they feel is needed to improve use of Instructional ma~ 
terlals. This questionnaire or interview form might 
be additional questions on the form developed under 
category "2b." 
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PART ONE 
COLLECTING PRELIMINARY 
INFORMATION 
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I: COLLECTIKG PRELIMIKARV ^ORMATION 



\ 

The Informacion in this part of the module includes sources of 
instructional materials /learning resources^ users of the materials, 
utilization of the materials, an evaluative checklist of character- 
istics of learning materials, and district guidelines for determin- 
ing the appropriateness of use of the materials. Also included 
are some questions adminis tar tors can be expected to ask about materials 
utilization. These questions should be considered When developing the 
interview or questionnaire form in Part II. 
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SOURCES OF MATERIALS 



The sources of oaterials from which teachers may draw will 
vary somewhat from district to district. Most of the sources below, 
however, will be available to teachers iu a larger district. Each 
source is listed and discussed briefly. 

1. District level library or learning resdurces center . Some districts 
have chosen to consolidate many of their materials purchased with state 
and/or local funds in a single center from which teachers »ay draw 
materials for classroom use. Such a center avoids duplication of materi" 
als in every building in the district and usually provides assistance 
from a staff specialist to consult with teachers about their needs. 
A district center staffed only by a clerk or secretary, however^ is 
unlikely to be very helpful since the clerical level person is not 
trained In instructional strategies and matching of strategies and 
materials to educational diagnoses. Provided the center is properly 
staffed it may become a primary source of help for teachers. The 
district center will often experiment with a single set of materials 
until the materials have been proven before it invests in multiple 
sets for school use. It also provides materials for examination and 
preview. 

2^ Library/learning resources center in each school building . The con- 
cept of unified print/nonprint or audiovisual collections and services 
is a reality in most states. Individual school libraries are quickly 
moving to encompass all formats of materials and appropriate hardware 
for their ase in each building. Staffing by professionals trained in 
books and media further enhances the usefulness of the LLRC. 

3. Education service center collections . In states that have regional 
education service centers^ some education service centers maintain cir^ 
culating collections of materials. A few service centers provide only 
an examination center from which teachers may obtain materials for 
preview before purchasing them for use in their own classrooms - 

4. Special Education Instructional Materials Center (SEIMC) networks . 
SEIHC networks have just recently undergone a name change to Area 
Learning Resource Centers. If materials are unavailable from a district 
center or an education service center* the regional service center tnAy 
initiate a request into the ALRC network ^or materials meeting given cri^ 
teria. On a statewide basis* or even a national basis* (utilizing the 
National Center on Educational Media and Materials for the Handicapped) 
materials may be obtained to help a given pupil. 
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5* Textbook center for school district * While textbooks supplied 
by the state or district are usually placed in schools under the 
responsiblity of the principal, at tisaes It is necessary to go to 
the district center In order to locate joaterials that use strate- 
gies needed for given pupils* Through the principal^ teachers 
should have access to all levels and t3rpe5 of textbook laaterials 
available in the district* 

6* Materials purchased by principal for use in a given building * 
Often quite substantial amounts of materials are found in one 
school because the principal and teachers have chosen to use the 
instructional funds» activity funds» or gift funds such ^s those 
provided by parent- teacher organizations to obtain materials Which 
teachers particularly wish to use with pupils* Sometimes these 
materials are housed in the library /learning resources center 
(which seems most appropriate and efficient) but often they are 
housed in given classrooms (a real disadvantage In having all 
teachers within a building know what materials are available*) 

7* Materials purchased by teachers . In spite of the responsi-* 
bility of the district to provide appropriate materials, it is not 
unusual to find teachers purchasing materials themselves in oirder 
to have the materials to use. Obviously, such materials are the 
teacher's personal property and lending them to other teachers is 
at the discretion of the owner. Occasionally, however^ teachers 
are willing to share their materials at least for examination 
purposes^ if not for actual use with pupils* 

8. Instructional radio and television . If the district participates 
in support of a broadcast or cable instructional television., system, 
the programming provided may be considered part of the learning 
resources available to pupils* ITV stations usually provide a 
teacher's guide and program scheduling on request* Sadly, many 
teachers Ignore the use of ITV because of scheduling difficulties 

or because they deem the programming Inappropriate for a whole 
class of pupils. 

9. Library of Congress Division of Service to the Blind and Physically 
Handicapped * Usually operating through the state library* the divi- 
sion provides '^talking books," plus some magazines and newspapers^ 

in audio recorded form for persons whose physical disabilities keep 
them from using regularly printed books* Persons who may qualify in- 
clude blind and partially sighted persons, cerebral palsied or other 
persons who find it difficult to hold a book* Service is available 
on long playing records or on cassettes; equipment is provided free 
of charge to users who are eligible and a franking privilege pro- 
vides free postage for returning materials to the library- Many 
special education pupils are eligible for the service but do not 
use it* A catalog of available materials is provided- 
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MATERIALS UTILIZATION 



1- Users of the materials . By getting ecquainted with the learning 
resources specialists coordinating use of the sources listed above, it 
will be possible to learn who uses the resources of any given agency^ 
For exattple, the building level library /learning resources special- 
ist will know if teachers cotae to obtain materials for use in the 
classroom and whether students use the resources of the library. 

Most agencies which provide materials maintain files of registered 
borrowers or maintain circulation records to know who their users 
are. A sample of the charge file at three given dates (the charge 
file contains a record of^all materials currently in circulation) 
will give a fair picture of the use and users of any given agency. 

Do the users of the sources of materials which are - available 
represent all, most, or only a small percentage of teachers? Are 
there reciprocal borrowing privileges among the different agencies 
which provide aaterials? 

2- Amount and frequency of borrowing from each source . The cir- 
culation records mentioned above help to indicate the frequency 
with which given teachers borrow tiiaterials and the quantities of 
materials they borrow. 

3. Non-users and their reasons . If a given teacher does not bor- 
row materials from any of the sources mentioned, why not? What 
perceptions of the non**user do the learning resource specialists 
have? What data does talking with a teacher who is a non-user 

of the sources provide? There may be several reasons a teacher 
chooses not to use the available source: all materials needed 
are in the classroom (unlikely)^ the hours at which materials 
may be obtained are inconvenient; the sources are located at in- 
accessible places; the lag time before obtaining materials is 
too long; circulation policies that restrict use of materials 
to two weeks do not allow for appropriate use in the classroom; 
there is no comprehensive listing of materials available from each 
source; if there is a listing, it does not tell enough about the 
materials to help in selecting appropriate materials for a given 
pupil; or the teacher is unmotivated to try new materials. 

4, £xtent to which materials are used . How many different items 
are used? With what frequency? From what sources have they come? 
These and other questions must be asked in the schools to deter- 
mine both quantity and quality of use. 



3. Materials in classrooms * Another approach to assessing the 
frequency and extent of materials use is to inventory the iztateri- 
als that are found In classes at a given tiiae. Although such an 
inventory does not indicate whether the materials are being used^ 
at least their presence provides for the possibility of use* From 
vhere do the staterlals found in the classrooDS come? Are they all 
from one or two sources^ or do they represent several of the sources 
listed above? 

6* Materials not used^ Persons in charge of the various iztaterials 
centers can help provide information on taaterials which are avail- 
able but are not used by teachers very often. Circulation records 
may also help provide such data* If materials are not being used^ 
why? Are they poor iztaterials? Are they complicated to use and 
teachers need help in arranging for their incorporation into pu- 
pils' learning activities? Are they incomplete^ lacking teacher's 
manuals or playback equipment? Are there expendable iteiss such 
as workbook sheets which have been used up and not replaced? Is 
tne cost of replacing such expendable items prohibitive or does 
copyright constraint prevent in-^house duplication of expendable 
items? Such data may be obtained on a visit to the school by the 
supervisor to inventory a selected sample of classrooms^ or it may 
be gathered by having teachers complete an inventory of items on 
certain dates not announced in advance. 

Among the materials found in the classrooms how many actually 
are in use and how many are on the shelf? If not in use^ why? \lhat 
are the materials that are actually used? Vhat are those that are 
sitting on the shelf? 

Are teachers using more materials for pupils with a particu- 
lar type of learning difficulty such as for partially sighted pu- 
pils^ or do they tend to use them for all pupils? 

7- Manner in which materials are used . Before the supervisor can 
assess the quality of use of materials with pupils^ it is neces- 
sary for him to have some knowledge of appropriate use of the ma- 
terials* Such knowledge comes from studying teacher's manuals^ 
validation data^ and other instructions prepared by the producer 
of the materials. Either written notes or a mental checklist of 
characteristics of materials will help the supervisor remember 
salient points of the materials. One such evaluative checklist 
follows* 
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A SAMPLE EVALUATIVE CHECKLIST 



Title of saterials 



Producer and address 



Cos t 

Forsat (list all co«p<ments): 



List expendable iteas vith cost 



Target audience 

Age Grade level 



Interest level 



Skills/attitudes taught 



Language^ geographic^ or ethitlc orientation_ 



Content area 



Definition of objectives: 

Not Vaguely 
Specified Identified 

1 2 



Clearly 
Identified 



Specified in 
Behavioral Tems 



Identification of entry level behaviors; 

Not Inferred 
Indicated Only 

1 2 



Generally 
Defined 



Explicitly 
Defined 



Coverage of Content: 
Superficial 

1 



Ttiorough in 
Part 



Systematic 
and Complete 



Technical quality of materials; 
Sloppy Amateurish 



Semi-professional 



Highest 
Professional 
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CocDOenc 



Procedures Provided for Evaluatioa 

Written Oral Performance Observation 

Technical quality of evaluation provided 

Inadequate Needs Elaboration Adeqtiate Very Good 

Expected pupil interest in materials 

Boring Questionable Interesting Exciting 

Feedback/reinforcement provided 

Lacking Seldom Usually Frequently 

Pacing controlled by 

Materials Teacher Pupil 

Validation Data 

Not Provided Some but Insufficient Sufficient Thorough 

Summary of your assessment: 



Do you recommend purchase? 
Will you use if purchased? 



N o Yes How many 

No Probably Definitely^ 

Name ^ 

S chool 

Posi tion 

Telephone 
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DISTRICT GUIDELINES 



Does the school district have guidelines/criteria which will 
help teachers and supervisors determine whether appropriate use is 
being nade of materials? If so, are they being applied? If not, what 
should a supervisor or teacher keep in mind in determining wbich mater-^ 
ials to use with a given pupil? 

1. Appropriateness for the pupil . Age/interest level of pupil, achieve-* 
sent level, special difficulties or limitations on use of materials, and the 
pupil's preferred learning modality must be considered in evaltiating 
whether materials are being used appropriately with a pupil. One 

very difficult aspect of selecting materials is finding materials that 
have fairly high interest levels and are fairly mature for older pu- 
pils, but are not too difficult in achievement level. Some materials 
require pupils to use visual symbols, others verbal symbols that may 
be spoken or may be written; and some use tactile items to reinforce 
learnings. Is there any one of these approaches most in keeping with 
a given pupil's learning modes? 

2. Characteristics of the materials , (a) What is the symbol system 
employed? Is it combinations of words, pictures, or other symbols? 
(b) What kind of realism cues are provided? How much practical detail 
is given in color, motion, dimensionality, and actual reproduction of 
sounds? These realism cues vary on a continuum from concrete .actual 
objects to the very abstract. Does the pupil need all detail sketched 
in, as in a photograph, or would he be confused by so much detail and 
'therefore requires that much visual noise as well as some information 

carrying visual elements be eliminated in the interest of getting to the 

basic information required? To what extent can the pupil generalize 

using abstract symbols such as language and numbers? (c) What sensory 
channels do the materials use— ^auditory, visual, tactile, or various 
dombinations of these? If combinations are used, does one sensory 
channel interfere with the other, or have factors of redundancy and switch- 
ing time been taken into account in combining the materials? (d) How 
much control does the user have over the use of the materials? Can he 
pace himself or sequence the materials to suit himself? Can he deter- 
mine when he will use the materials, or are there outside constraints 
such as time of a television broadcast or given time of day when time 
'sharing programs and open lines require use of computerized instruc-* 
tion? To what degree is the ability to pace, sequence, and determine 
use of materials desirable for given pupils and when is it undesirable? 
(e) What kind of learner response demands are made? What kind of 



practice does che learner have? Vhat kind of feedback does he receive? 
While the answers to the questions about characteristics of nedia vary 
greatly in temts of pupils and many other variables, at least some know^ 
ledge in chis area will help teachers choose wisely. (Levie) 

3- Quality of instructional design. How carefully do the materials de- 
fine objectives stated in measurable terms? Do they give evidence of 
having been carried out in the preparation of the materials? Vhat 
helps are given teachers in che assessment of learning that has taken 
place as a result of using the materials? Have the test or evaluation 
questions been validated? Vhat steps will the teacher need to take in 
order to use the utaterlals? How time consuming and difficult will 
any preparatory steps be? 

4. Potential for modification of materials , Would the materials be trans- 
latable into another medium* such as filmstrip to slides^ audiotape to 
script, or phonodisc recording to cassette tape?' Vhat effects- on learning 
would such modifications have, if any? Do the materials lend them- 
selves to division into shorter^ smaller learning units should that be 
necessary? Do they lend themselves to consolidation into larger units 
for pupils who move through them more rapidly than expected? Vhat is 

the frequency of feedback and reinforcement given pupils? Should the 
schedule of reinforcement need to be increased or decreased for a given 
student, would such modification be possible? 

5 . Appropropriation of instructions to local classroom needs . Teachers 
should be expected to follow the design of the materials and the^ pre^ 
pared instructions for use of materials unless they have already tried 
them 3nd modified them for better results. Too often, teachers do not 
take or have time to follow the instructions that accompany materials or 
they tinker with the instructions, only to find that the materials do 
not result in the learning expected. 

6. Teacher motivation for using materials . Vhat kinds of reinforcements 
are given to teachers who try new materials? Are they given opportu- 
nities to submit reports of such trials for publication? Are they en*^ 
couraged and supported financially and otherwise in submitting papers 

to meetings and presenting them? Are notes about use of new materials 
made in teacher personnel files? 

7. Pupil motivation for using materials . Certainly interest in the 
materials, pleasurable experiences while using them and a sense of learn- 
ing from the materials all provide continuing motivation. Vhat kinds of 
tangible and visible reinforcements of this type do the materials offer? 



INFCNRHATIQN NEEDED BY AEKINISTRATORS 



If iaproveaents are to be made district*vide in the use of 
aaterials^ administrators need to be stqyplied with information 
that can be used in decision making. Information supplied should be 
about learali^ resources^ personnel^ space^ and equipment or other 
budgetary items that lmpro;ure the use of learning resources, 

1, About materials . Where are the materiala actually located and 
used? Have they placed in the district center? tfere funds or 
materials channeled to the region service center? tfere materials 
placed in individual schools? Vhich ones? Approximately what 
percentage of materials purchased are found through each source? 

What percentage of materials available to teachers are actually 
being used? With what frequency are they being used? Are equipment 
and space available for maximal use? 

ttiat percentage of teachers are actually using some of the ma- 
terials? 

What cost Investment per pupil has been made in materials each 
year to date? How does this figure compare with the guidelines in 
the administrative handbook? 

2: Other materials available for pupils . To what extent do special 
education pupils have access to the materials provided by the dis^ 
trict for all pupils? Are teachers allowed access to these loaterials 
without prejudice? Such materials will include the availability of 
textbooks^ including teacher's guides and accompanying media^ and 
expendable materials such as workbooks and tests. Are special edu- 
cation pupils allowed unhinderea access to the building level library/ 
learning resources center? Does the staff in charge make special 
provision for Special education pupils in selecting materials and 
in planning programming activities? What ±s the amount of use of a 
building level LLRC by special education pupils ^nd teachers compared 
with the use by other teachers and pupils? 

Does the district participate in funding the region service cen* 
ter special education materials collection? If so^ is access to and 
delivery of the materials commensurate with the supp5^ t TtippTied 1>y 
the district? What percentage of support does the district give the 
service center materials collection and what percentage of use of the 
center's materials is represented by the district? 

If the district supports instructional television programming^ do 
special education pupils have access to receivers for viewing at 
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appropriate ciioes? How many pupils use Che television programing 
and what percentage of special education pupils is this? 

What other conmunity, state, or national sources are being 
exploited by teachers of special education pupils? 

What is the mean cost of materials purchased by teachers from 
their own pockets during the past year and ^at is the range of costs? 

3* Odier Needs ^ If additional staff support is needed to improve 

materials use, how many man hours per week are represented by the 

needs? Hov many full time equivalent aides or clerks does this 

represent? 
« 

If additional equipment is needed, what is the total cost and the 
cost per pupil, including service contracts and blank software for 
local production? Could production of materials be centralized to 
avoid duplication of equipment? 
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PART TWO 
CONDUCTING A FORMAL 
STUMf or MATERIALS UTILIZATION 
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COKDUCTIKG A FORMAL STUDY OF MATERIALS UTILIZATION 



Part TWo of this packet includes some suggestions on conducting 
a materials utilization study. Formal observation of use of saterials 
and some anticipated responses to interview questions on how to Im^ 
prove the use of materials are included. 

Obviously all teachers in the district cannot be formally 
observed or interviewed, so a sample of the total teaching popular 
tion must be drawn. The sample should be determined on the basis 
of grade levels, disabilities represented, curriculum patterns in 
the different schools and other factors. Also, teachers to be 
interviewed or observed might be selected for a variety of numbers 
of years experience and educational preparation. 

Objectives of the study, whether interview/questionnaire or 
observation, must be determined. Primary consideration must be 
given to how the information collected will be used. 

In structuring the questions to be asked or what is to be ob*^ 
served, ease of tabulation once tlie data is collected should be 
remembered, and whether it is possible to quantify the data. 
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OBSERVATION OF USE OF MATERIALS 



A helpful data gathering device is to observe actual use of laateri*- 
als in classrooitts. A saiopling of classrooms and materials in use might 
be chosen. 

For accurate recording of observations, some type of guide or 
checklist appears useful* What should such an observation guide con- 
tain? Perhaps the supervisor desires data about pupils uho are using 
Che materials^about procedures being followed, about the materials 
themselves, or about pupil responses and attitudes toward the ma- 
terials* Some of the above data might be Implied by observation of 
what is being done in a given classroom* 

In addition, talking with pupils and teacherr about their use of 
materials can prove helpful* Questions might include those such as 
Che pupil's liking for che macerials, whac he enjoys mosc abouc them, 
what he likes least about them, and what he perceives he has learned 
from them. Similar questions might be asked of teachers* Teachers' 
perceptions of how easy the materials are co use, how che nacerials 
compare wich similar ones and che lengch of cime the materials main- 
tain pupil interest all prove helpful- 

Observational Information from other professionals * Other persons in 
che building may be able co supply impressions abouc the frequency and 
extent of use of some instructional materials* If the principal spends 
time ob^rving in classes, his opinions should be sought* Librarians/ 
learning resources specialists are trained to talk with teachers about 
materials in relation to pupil learning. What is their evaluation of 
both the extent and quality of use of materials in a given classroom? 
Are they being asked co supply supplemencary macerials relacing co 
chose in use in che classroom? Do che macerials in use scimulace pupils 
and ceachers co seek addicional macerials from che learning resources 
cencer? Do chey puc a heavy drain on equipmenc available chrough che 
cencsr? 

Ocher supervisors who visic the building may have casual observa^ 
tions based on discussions with other teachers, or actual observation 
in classes* Student teachers and their college supervisors may also 
be able to supply such information* 
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LNTERVIEW OR QUESTIONNAIRE ON 
IMPROVEMENT OF THE USE OF LEARNING RESOURCES 



While gathering data on the extent and quality of use of learning 
resodtcesy an opportunity is provided to gadier opinions and percep- 
tions of teacher and other professionals about what would iaaprove the 
use of materials* Interview questions or a written questionnaire or 
both should be considered as instruments for this purpose* 

Persons consulted — Who are the users of materials and the personnel who 
supply materials to the users who might have insight into both positive 
and negative aspects of the use of learning resources? Certainly teach- 
ers should be consulted first about the use of materials in classrooms* 
Some principals who are sensitive to teacher aotivation and instruc- 
tional problems may also provide useful data* 

Among persons at the heart of the process involved in helping 
teachers obtain learning resources are library /learning resource 
specialists in each school building, and the district*s librarian/ 
resource specialist or the regional service center learning re- 
sources specialist* These persons may either be helpful in diag- 
nosing problems or they may inadvertently be a part of the problem 
because of the regulations for borrowing, timing of purchases, and 
other policies they help to determine* A detailed discussion with 
materials specialists is a necessary and useful activitiy* 

Problems in using instructional materials — Some speculation about the 
responses that will be obtained from fhe persons consulted will be , help- 
ful in frading a questionnaire or in^^Wiew form* Some of the responses 
may fall into the category of problems requiring administrative cor^ 
rection* Others may concern changes that can be made on the building 
or district level without administrative approval* Still others may 
involve teacher skill and motivation and will become likely areas of 
concern in planning in'-service education* 

1- Lack of support staff . Some teachers ^7 feel that with the 
high degree of individualization required of many materials, support 
staff members are needed to help pupils use the materials* Staff for 
duplication of expendable materials, and for adequate record keeping 
of pupil progress may be another problem mentioned* 

2, Insufficient diagnostic data * Other teachers and materials 
specialists may feel that they have insufficient diagnostic data about 
pupils to select materials particularly appropriate for a given pupil* 
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Whije teachers rn^y be twined to leather some of this data, and routine 
testing and pupil placement testing nay provide other data, special 
information is sometimes lacking on learning loodalities^ unusual 
learning disabilities, problems with social adjustment, personal re- 
actions to certain school activities, and pupil attitudes* If such 
data are not forthcoming froia educational diagnosticians at the 
district or regional level, the supervisor may need to consider ways 
in which such data can be obtained* 

3* Inflexible work space * From time to time, teachers complain 
that they cannot have pupils use Individualized materials because there 
is no quiet place for them to work i.n an undlstracted manner and with- 
out interruption* Makeshift or simple table top carrels often pro- 
vide the answer to such objections* Rearrangement of space or reallo- 
cation of space with the cooperation of the principal may prove to be 
the catalyst that encourages teachers to experiment with different 
materials and instructional approaches* 

4* Unavailability of equipment . Since many learning materials 
systems use audiovisual media, the availability of playbadc equipment 
may be ^ negating factor. Sometimes the equipment is unavailable, or 
is not maintained adequately* Some problems also occur when inexpen- 
sive equipment meant for personal use, such as cassette players, are 
purchased for heavy-duty school use. Learning resources spe^^ialists 
should be able to help in purchase of future equipment and supervisors 
should be acquainted with the work of the two major evaluative agen-* 
cles for educational equipment: 1. Educational Products Infonnatlon 
E xchange Reports (EPIE) and 2* Library Technology Reports (LTR)pro- 
duced by the Council on Library Resources Additional equipment 
evaluations appear in journals but they do not compare different 
brands of the same product as do EPIE and LTR* Sometimes the problem 
with playback equipment is lack of service contracts or locally avail- 
able service so that there are large amounts of down time* At other 
times the problems of teachers and pupils concern borrowing regula- 
tions that are restrictive and do not allow sustained use of the equip- 
ment* Sometimes, teachers are afraid to let pupils use equipment for 
fear that it will be broken. Considerable effort may need to be ex- 
pended to assure teachers that equipment is meant to he u^ed and 
personal liability is not at intake when equipment wear.s out or 
needs repair. 

5. Borrowing regulations. Borrowing regulations concerning equip- 
ment also bring up the question of borrowing regulations for learning 
resources. Unfortunately, the usual library borrowing period of two 
or three weeks sometimes is imposed on learning resources that are 
meant to be used over a period of a semester or term* Such regulati<:ins 
stifle the use of materials and cause teachers tc cease to experiment 
with them. 
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6, Purchasing policies , A problep related to business office 
policies but that sometimes oay be controlled within the learning 
resources centers or within regulations set by the supervisor, con- 
cerns the timing of purchases of materials. It a teacher uses materi- 
als from a regional center and finds them ideal for a given group of 
pupils. It should be possible to purchase them for use in that school 
promptly (three to four weeks at most) rather than have to wait for 
some arbitrary ordering date. Often the pupils who need the materi- 
als have moved on to another school by the time materials arrive* 

7* Lack of variety of materials . Undoubtedly some teachers 
wil] suggest that more variety in the materials available would en- 
courage them to use more resources. This is a convenient excuse and 
in order to pinpoint what Is meant by variety, teachers should be 
questioned as to whether they mean variety in level of materials, 
content areas, synkbol systems, responses made by pupils, feedback, 
or other characteristics. If the teacher can identify specific needs 
in terms of variety, useful data for future purchases may be pro- 
vided. 

8. Lack of duplicate copies . Another serious complaint, espe* 
daily when teadiers use a district-^ide learning resources center, 
is the lack of sufficient duplicate copies of popular materials such 
as the Sullivan programmed reading materials from McGraw*Hill; cuisenaire 
rods, Weston Woods cassettes and books REACH programs by Economy Co., 
and Cracking the Code from Science Research Associates. Materials 
which have proven successful with pupils should be purdiased in mul- 
tiple sets or copies so that diey are available when and where needed* 

9- Insufficient planning time . Other teachers may raise the prob- 
lem of insufficient planning time to exami)?e materials and plan use of 
the materials with individual pupils. This Is a justifiable complaint 
in most schools where teachers are expected to spend one afternoon 
per week in faculty meetings, another in in~servlce meetings, and 
possibly still another afternoon or evening working with professional 
organizations* A re-evaluation of after school requirements may be 
indicated. 

10. Lack of teacher preparation * A few teachers may be brave 
enough to admit to the supervisor in an interview situation that they 
do not know how to use many of the materials which are available to 
them^ Often, however, such critical information may be elicited only 
through anonjnnous questionnaires or other non- threatening procedures. 
It appears that many teachers are not clear about the staff function 
of supervisors and tend to regard them as line officers with hiring 
and firing power. 
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Designing a Study of Available Resources; 
SELF^EVALUATIOH CHECKLIST 



Please do not vrice on this page. Use the Self-Evaluative Checklist 
Work Sheet, page 36 to record yotir answers* 



1. Have you Identified and listed the sources of instructional 
isate rials/learning resources available to teachers? 

Yes No 

2* Did you include a brief description of each source in your list? 

Yes No 

3- Have you developed a fona for inventorying the learning resources 
available in a classroom at a given time? 

Yes No 

4. Have you- prepared a report on procedures for determining which 
materials are not being used? 

Yes_^ Ho 

5. Have you prepared a report on the reasons non-users do not exploit 
the sources of materials? 

Yes No 

6. Have you developed an evaluative checklist of learning materials 
characteristics? 

Yes No 

7. Have you evaluated a set .of learning materials using your checklist? 

Yes Ho 

8. Have you prepared district guidelines to determine if materials 
are being used appropriately? 

Yes No 

9. Have you developed a form for recording observations of pupils and 

teachers using learning resources? 

Yes Ho 

w 

OR 

Have you developed a questionnaire or interview form that will 
elicit from teachers and pupils their perceptions of the desirability 
of given learning resources? Yes 
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10. Bava you developed a questionnaire or interview form to be 

used with other professional personnel wbo observe and/or participate 

in the choice of learning resources? 

Yes Ko 



11. Have you developed a questionnaire or interview form that will 
elicit from teachers suggestions about assistance needed to improve 
use of instructional materials? 

Yes No 



Designing a Study of Available Resources 
POST-TEST 



Please use the Post-Test Vbrk Sheet, page 37, to record your answers - 

1* Name at least five sources of instructional materials avail- 
able to teachers. 

2. An evaluative checklist should request some non-evaluative in-* 
formation (cost^ format, target audience) and some evaluative infor- 
mation. Name at least ^ areas on the checklist calling for evaluative 
information.'^^ " 

3. Which one of the following areas should not be included in 
district guidelines for determining whether appropriate use is 
being made of materials? 

a* appropriateness for pupil 

b. characteristics of the material 

c. cost and producer of materials 

^d. potential for modification of the ciaterlals 

_e. quality of instructional design 

4. What are the two major evaluative agencies for educational^ 
equipment ? 

5. Who are 3 groups of professionals who may be able to provide 
observational information on the extent of use of instructional 
materials in classrooms ? 

6. Hame at least 6 problems in using instructional materials 
teachers may mention in an interview or on a questionnaire. 



POST-TEST ANSWERS 



District level library or learning resources center 
Library/learning resource center in a school 
Education service center collections 

Special Education Instructional Materials Center (SEIMC) 

Area Learning Resource Center 
Textbook center 

Materials purchased by principal 
^^aterials purchased by teachers 

Instructional radio and television ^ 
Library of Congress Division of Service to the Blind and 
Physically Handicapped 

Ratine of Definition of Objectives 

Rating of Identification of entry level behaviors 

Rating of Coverage of Content 

Rating of Technical quality of materials 

Rating of Procedures for evaluation from ''inadequate*' to 

"very good** 
Rating of Pupil interest in materials 
Rating of Feedback/Reinforcement 

c 

Educational Products Information Exchange Reports (EPIE) 
Library Technology Reports (LTR) 

Principals 

Librarians/learning Resources specialist 

Teachers 

Supervisors 

Lack of support staff 
Insufficient diagnostic data 
Infle3cible workspace 
Unavailability of equipment 
Borrowing regulations 
Purchasing policies 
Lack of duplicate copies 
Insufficient planning time 
Lack of teacher preparation 
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MATERIALS TO BE EVALUATED 



Cracking the Code , The Key to Independent Reading. Science 
Research Associates, 259 East Erie Street, Chicago, Illinois 
60611. 

Teacher Guide by Dcmald Rosnussen and Lynn Goldbey 
Wbrkbook 
Iteader 

Culsenalre Rods , Number In Color. 

Culsenmlre Coiupany of America, Inc. 

12 Church Street 

New Rochelle, N.Y. 10805 

Boxed Rods with teacher's manual. Opening Doors in Mathematics . 

Sullivan, M. tf. and Buchanan, C. D. 

Programmed Reading , Teacher Guide to Book 1, Series one/3d ed. 
Programmed Reading , Teachers Guide to Book 1, Series one/3d ed. 
Prograimned Reading Books 1 and lA, Book 2, Book 7 
Student Response Booklets, Book 1 and la. Book 2, Book 7 
Word Cards 

Films trips for Series I 

All from Uebst^r/McGraw Hill 

1221 Avenue of the Americas 

New York, N.Y. 10020 
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APPLYING THE RESULTS OF THE MATERIALS 
UTILIZATION STUDY 



Personnel 



1. Teachers , Upon completion of a study such as mentioned above, 
teachers will expect- to receive some information as feedback. A 
variety of approaches to reviewing the findings with teachers should 
be explored, such as a report to each faculty, small group meetings 
or workshops. 

2. Administrators . Administrators, in addition to using the infor- 
mation for decision making, will probably wish to use the study to 
develop a time frame in which to implement recommendations of the 
study. What changes could be Implemented immediately to improve the 
utilization of materials? What tasks will take several months to 
begin? Which recommendations must await another fiscal year and 

a revised budget in order to begin? Which recommendations can be 
implemented without massive changes in existing schedules, in^ervice 
days, and other plans that have already been formulated? Which will 
require long-range changes involving staffing, space, and purchase 
of materials ? 
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In-Service Needs 



1- In-service days. What needs have been uncoveredl In the process 
of this utilization study that point to topics which should be dealt 
with through In-service activities? What changes are expected to occur 
due to the In-service program? How much time can such activities 
be 'expected to take . • • either during pre-^chool workshops , re- 
lease time workshops, or after school programs? What personnel are 
required to conduct the in*service activities? lihat should be the 
long range objectives of such activities? What costs would be 
incurred that should be budgeted for in the next two years? 

2. Consultative assistance . Time during which the supervisor can pro- 
vide together with other qualified professionals, consulatative ad- 
vice on selecting materials for given pupils must be considered. 
If time does not permit individual coEisultation, perhaps working 
with three of four teachers at once would be a useful approach. 
Development of a profile form which would be completed for each pupil 
and learning need so the teacher can articulate precisely the individual 
requirement In terms of learning resources might be considered. Devel- 
opment of such a profile/checklist would be a worthwhile undertaking 
for a group of teachers working with the supervisor and materials 
specialists during in-service programs. Once the profile Is developed, 
the next step might be the preparation of self-instructional materials 
or small group instructional materials including audiotapes and sample 
materials, to accompany the profile. 
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SOURCES 



1. Manual of guidelines . If a manual of guidelines concerning 
materials for pupils does not exist, the possible development of one 
based on the findings of the study might be considered. It then 
could provide the basis for basic orientation of new teachers in the 
system and perhaps for one or two in-service sessions with all 
teachers. If a manual is not developed^ teachers should at least be 
informed of the sources of materials for pupils, of the number and 
variety of materials available and the requirements and procedures for 
borrowing such materials. 

2. Catalo_g of resources . A catalog or descriptive list of materials 
available to all teachers in the district is necessary, especially 

if it contains descriptive information about content and about learn- 
ing needs the materials may meet. Although keeping such a catalog 
up-to-date presents many problems, it is essential if teachers are 
to be expected to use a variety of learning resources. 

3. Evaluation and selection of resources . Teachers should have con- 
siderable input into the choice of materials purchased^ Setting up the 
mechanics for preview and evaluation of materials is another type of 
in-service activity that would help teachers become more proficient 

in their knowledge of materials. 

Refer to Educational Products Information Exchange. EPIE Report 
#5^* . Improving Materials Selection Procedures: A Basic "How To" 
Handbook 1973 . (listed in Bibliography) ^ 

4. Local Production of resources . Recognizing that at times there are 
no commercially prepared materials that meet precise learning needs, 
teachers may wish to have an opportunity to learn to produce simple 
materials themselves. Enlistment of the aid of audiovisual and learar 
Ing resources specialists again is needed. Assuming, however* that 

if one or a few pupils neetl materials especially prepared for them 
there may also be a demand for such materials on a wider scale, 
teachers may wish to consider the possibility of preparing materials 
to meet given pupils' nee^^s and then making them available for wider 
distribution. As an exam;>le of the needs and procedures called for 
In such reproduction and wider distribution, 

Refer to John C. gelland and. Sidney Rothenberg, Developing In- 
structional Materials for the Handicapped . Guidelines for Pre- 
paring Materials Suitable for Wide Distribution . Columbus: 
Ohio State University, National Center on Educational Media and 
Materials for the Handicapped, 1973. (listed in Bibliography) 
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5- Vso of network * Other teachers may require detailed instruction and 
considerable encouragement to use the Special Education Resource Center 
network. Instruction in accessing the resources of the network through 
the regional service center or through the Area Resource Center may 
need to he given* For consultative help in completing request forms 
for searches of computerized data banks available through the net- 
work at an Area Resource Center^ 

Refer to: User's Handbook and Thesaurus: Instructional Materials 
Information Retrieval Program . 1973 Edition. SEIMC, 
The Department of Special Education, University of 
Texas at Austin* (listed in Bibliography) 



Designing a Study of Available Resources 
SELF-EVALUATION CHECKLIST 
WORK SHEET 

Nacie Date 

Soc* Sec No* r T 

Your Score 



1. 


Yes 


No 


2. 


Yes 


No 


3. 


Yes 


No 


4. 


Yes 


No 


5. 


Yes 


No 


6. 


Yes 


No 


7. 


Yes 


No 


8. 


Yes 


No 


9. 


Yes 


No 


10. 


Yes 


Ko 


11. 


Yes 


No 



If you did not check *'yes*' on each item^ either add the information 
to your task assignment or write a brief explanation as to why the 
item was not included* 



Designing a Study of Available Resources 
POST-TEST WORK SHEET 



Name Date 

Soc Sec No. ~ - Your Scorc_ 

1. 



5. 
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MST Of IM>iiPHNI>KHT STUDY MATFRIAL 
DEVELOPKD BY THE SEST PROJECT 



^The Pelphi Technique for Curriculum Planning 

A-l Settinn Instructional Co.ils (Docuiient llOa) 

Desiftning n Concept Development Unit 

A-2 Designing Instructional Units (Uocuaent llOb) 

Designing a Study of Availnble Rc>;ource$ 

3-3 Evaluating the Utilization of Learning Resources (Docuaent llOc) 

Developing Job Descriptions 

C-1 Devulopjtig n f>t*iffing Tlnn (Document #10e) 

Mnterlnl Select' inn 

Ti-1 Evnluating ami Selecting Learning Katerlftls (Dociment llOd) 

Preparing Schcnl Ifcws Kelcnscs for the Media 
G-1 Informing the Public (Document jflOh) 
, ■ 

Selecting Personnel for a New School Program 

C^2 Recruiting and Selecting Personnel (Docuinent llOf) 

Self-Instructional Module on Time Utilization 

D-1 Revising Existing Structures (Document llOg) 
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A Directory of Comfxitency^Culdcd .Supervisory Training Materials for 
Indcpenlcnt Study (]X>cumcnt ^^9) 

A Selected Bibliography for Professional !>upervlsory Conpetencies 
(Document 18) 
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